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The characteristics of a time-delayed system with time-dependent delay time is investigated. We 
demonstrate the nonlinearity characteristics of the time-delayed system are significantly changed 
depending on the properties of time-dependent delay time and especially that the reconstructed 
phase trajectory of the system is not collapsed into simple manifold, differently from the delayed 
system with fixed delay time. We discuss the possibility of a phase space reconstruction and its 
applications. 
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The effect of time delay due to a finite propagation 
speed of information is usually considered as the form of 
delay-differential equation: x = f(x(t), x(t — Tn)j, where 
Tn is the fixed delay time 0, S S HE ft H H M, M, 
ll^ . It has been found that the system actually exhibits 
many different behaviors depending on the nonlinearity 
and the delay of the system and that the dimension of the 
attractor rises linearly with the delay time, even though 
the number of degree of freedom is small 
the last decade, models based of delay time have been ex- 
tensively investigated in various fields such as optics^], 
biology 0, 0] and chemistry for the purpose of un- 
derstanding its fundamental role and of applying it to 
control 0] and communication 0] ■ 

The models based on fixed delay time, however, often 
fail to properly cover such real factors as (a) memory 
effect of the oscillator, (b) approximately known delay 
time, and (c) time-dependent delay time [l3,llJjll3- To 
cover these factors, Volterra first proposed a model based 
on distributed d elays fl3| . The model has been used in 
various areas [14lll5l,ll6| . It has been shown very recently 
that the distributed delay induces a death phenomenon 
in a much larger set of parameters than that of the fixed 
delay |l5j. Thus the Volterra's model has enabled us to 
understand the realistic effects of delay times in dynam- 
ical systems. 

Meanwhile, in studying the population dynamics and 
epidemic problems the delay time has been considered as 
a function of state variable an d there have been ex- 
tensive investigations in that direction. However, there 
are many real situations in which the dynamics of delay 
time can not be described by an analytic function, e.g., 
neural networks and internet 0] . So it is reasonable to 
introduce time-dependent delay time as a stochastic pro- 
cess in those cases. In this point of view we shall inves- 
tigate the effects of time-dependent delay time (TDT) 
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FIG. 1: temporal behaviors of the modified Mackey-Glass 
model in the presence of TDT when to = 200, T = 100, 
and A = 10: (a) state variable x; (b) the delay time; (c) 
autocorrelation of the time-dependent delay time. 



in dynamical systems governed by a stochastic process 
and the effects in time-delayed systems remain much less 
studied. 

The main goal of this paper is to show how TDT al- 
ters the characteristics of time-delayed systems. In ad- 
dition, we analyze these characteristics with regards to 
application to communication. We consider the modified 
Mackey-Glass model. The Mackey-Glass model was 
introduced as a model showing the regeneration of blood 
cells in patients suffering from leukemia. The modified 
Mackey-Glass model is given by, 
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where a = 0.2, b = 0.1. While in the Mackey-Glass 
model the delay time is a constant t = tq, in the modified 
Mackey-Glass model r is a function of time. Especially 
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FIG. 2: One step prediction errors for A = (filled triangle), 
A = 10 (square), and A = 50 (filled circle). 



we focus on the case where r(t) is governed by a stochas- 
tic process £(t). As an example, we introduce the signal 
£(t) which is generated by the discrete sampling of the 
chaotic signal x(t) such that £(t) = x ( nT )- x i( n - 1 ) T ) A, 
when t G [nT,(n + 1)T). We note that this form of 
the signal was taken for the convenience's sake, which 
allows us to adjust the correlation length and modula- 
tion amplitude. And £ actually exhibits quasi-stochastic 
signal because we shall study the sampling period of 
T G [100, 1500] which is the larger than the correlation 
length of x (the correlation length of x is t x « 70 in 
the same parameters of Fig. 1. Our main results would 
not be changed if we use real stochastic signal for driv- 
ing the delay time, because those results are related with 
the fact that the delay time is not determinable). Here, 
A and T are control parameters for the stochastic sig- 
nal. They are proportional to the amplitude of r(t) and 
its correlation length, respectively. The limit A — > re- 
stores the system to the Mackey- Glass model. Figure 1 
(a) and (b) show the temporal behavior of the modified 
Mackey-Glass model with TDT. In Fig. 1 (c), one see 
that the r has the the correlation length of 0(T). 

One of the most sensitive measures to detect the delay 
time of a system 0, El is the one step prediction error 
|l2j |. In the sufficiently small patch Uj on (x{, Xi- T ) plane, 
it is defined by a](r) = j±- Y,e t eu 3 ~ 9j(vi)) 2 , where 
Vi = (xi,Xi— T ) and Njj, are the numbers of data points 
in patch Uj. Here, x — X i t+St )~ x ^ t ) j s ^ ne time variation 
obtained from the observed signal x{t). St is the sampling 
interval which should be much less than the characteristic 
time scale of the system (we took St — 10~ 3 ). gj is a 
local linear function such that gj (vj ) = bj + a ■ v*j , where 
the parameters bj and 3j are determined by the least 
square fitting. When this occurs, Oj is minimized |l9j . 
Therefore, the one step prediction error a is the average 
of the minimized dj, i.e., er = ((Tj). 

Figure 2 shows the one step prediction errors for the 




FIG. 3: Reconstructed phase trajectories of the modified 
Mackey-Glass model in (x(t),x(t — r)) space:(a)-(c) fixed de- 
lay time (A = 0); (d)-(f) time-dependent delay time (A = 
50). The reconstructions were performed at the lag time 
r = 190((a) and (d)), 200((b) and (e)), and 210((c) and (f)), 
respectively. 



modified Mackey-Glass model depending on A. In the 
case of a fixed delay time (filled triangles) one can see 
that cr(which has a value of a = 1.8 x 10~ 5 ) has a sharp 
peak at r = 200. However, if the time dependency of de- 
lay time is turned on, i.e., A ^ 0, the depth of the peak 
decreases as the A increases. Eventually, the peak almost 
disappears. At A — 50 (filled circles) the prediction error 
has an almost constant value of 3.2 x 10~ 2 . This means 
that if one detects the fixed delay time r , one can pre- 
dict the time series 10 3 times as precisely. As we shall 
see, it is closely related to the fact that the phase trajec- 
tory on the (x(t),x(t),x(t — r)) space collapsed into the 
simple manifold. This is the crucial feature of the system 
based on the fixed delay time To- And Biinner et al. |l2^ 
have shown that the delayed system can be modeled by 
the time delay embedding when tq is exactly detected. 
Meanwhile, in the case of TDT any detectable imprint 
is not left in the prediction error above the appropriate 
value of A. This feature indicates that the conventional 
modeling method for the delayed systems is not directly 
applicable. 

Figure 3 shows the reconstructed phase trajectories for 
fixed and TDTs in (x(t),x(t — r)) space. When the de- 
lay time is fixed (the first row of Fig. 3), the trajec- 
tory suddenly collapses into a quite simple shape at the 
value of r = 200 (Fig. 3 (b)), while the others look very 
complex (we shall discuss the feature quantitively in the 
next paragraph). This explains why the prediction error 
sharply drops in the case of fixed delay time (filled trian- 
gles in Fig. 2). On the contrary, when the delay time is 
time-dependent (the second row of Fig. 3), one can not 
see any qualitative difference which coincides with the 
fact that the prediction error is almost constant in Fig. 
2 (filled circles). This is a genuine effect caused by the 
nature of TDT. It presents a possibility that the delayed 
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FIG. 4: The filling factor as a function of lag time r. It is 
evaluated on (x(t),x(t — r),x(i)) phase space when A = 
(circles) and A = 50 (squares). We have taken the 10 2 x 
10 2 x 10 2 number of hypercubes for the region x € [0.0, 2.0] , 
x(t — t) £ [0.0, 2.0], and x £ [—0.1, 0.1] and we have iterated 
the systems during 5 x 10 4 seconds for each point. 



system with TDT can be used in communication with 
better performance. 

To quantify the complexity of the attractors, we eval- 
uate the filling factor which is the normalized number of 
hypercubes visited by the projected trajectory [l^. ^ i s 
one of the measures which directly show the complexity 
of the projected attractor. The results are presented in 
Fig. 4. In the case of TDT (filled circles in Fig. 4), 
the taken phase space is filled by 10% and it hardly de- 
pends on the chosen time lag r for reconstruction which 
explains the above description for Fig. 3 (d) - (f). In case 
of fixed time delay, if the time lag appropriately chosen 
as r = 200, the attractor only fills 1% of the taken phase 
space. Thus one may say that the reconstructed attrac- 
tor of Fig. 2 (e) is 10 times as complex as that of Fig. 2 
(b) based the values of the filling factors. 

In order to perform phase space reconstruction, the 
first step one must take is to find out the lag time r e for 
the delayed coordinates [2(], • It is usually determined 
by the first minimum point of the average mutual infor- 
mation. The average mutual information is defined by 
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Figure 5 shows the average mutual information in the 
cases of fixed delay and TDT. For the fixed delay time, 
the average mutual information has a peak near r = 200, 
which has the same implication with that of the predic- 
tion error in Fig. 2. On the other hand, for TDT, the 
average mutual information has the delta function shape. 
This means that the information of the observed time 



FIG. 5: Average mutual information of the modified Mackey- 
Glass model: (a) fixed delay time (A = 0) and (b) TDT at 
A = 270. 



series deteriorates more rapidly by TDT, compared to 
that of the fixed delay. Both of them have a wide range 
of degenerated minimum. In the latter, one can expect 
that the delay coordinate for phase space reconstruction 
would not be so unique because the degenerated region 
is wider than that of the former. 

To analyze the global effects of the system according to 
the property of the driving signal, we consider the metric 
entropy defined by h = J2 x ( n ) p ( x ( n )) lo S2i 1 / p ( x ( n ))} 
which is a measure of complexity or strength of nonlin- 
earity of the system ||. It corresponds to the value of 
the average mutual information J(r) at r = 0. Figure 6 
shows the entropy as a function of T and A. The value 
of entropy increases as A and 1/T both increase, while 
in the delayed system with a fixed delay time it is almost 
constant y|. Therefore, we understand that the profile of 
TDT plays a significant role that controls the complexity 
and nonlinearity of the time-delayed system. All obser- 
vations lead us to conclude that the nonlinearity char- 
acteristics of the time-delayed system are significantly 
changed depending on the properties of time-dependent 
delay time and, especially, that the reconstructed phase 
trajectory of the system is not collapsed into simple man- 
ifold, differently from the delayed system with fixed delay 
time. 

In conclusion, we have studied the characteristics of 
the time-delayed system in the presence of TDT. By pre- 
senting the numerical evidence, we have shown that the 
time-delayed system with TDT transits to the uncollapsi- 
ble hyperchaotic system. This fact implies that the phase 
space reconstruction of the systems with TDT is hardly 
possible. The reason is that phase reconstruction meth- 
ods for a time-delayed system usually assume the exact 
determination of fixed delay time 0, [^. We expect 
that these characteristics of the time-delayed system with 
TDT should be useful to implement communication sys- 
tems. 

The authors thank M.-W. Kim and S.-Y. Lee for help- 
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FIG. 6: Entropy of the modified Mackey-Glass model as a 
function of T and A 
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